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PROPOSED EXAMINER'S AMENDMENT 

1 . An examiner's amendment to tine record appears below. Sliould tine clianges 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1.312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Jason D. Eisneberg on 6/1 5/1 1 . 

2. The application has been amended as follows: 
Please cancel claims 1 1 , 1 2, 25, and 26. 

Please amend claims 1,13, 27, and 41-43 as follows: 

Please amend Claim 1 as follows: 

A graphical user interface for managing a plurality of system components within a 
controlled environment , to perform a so l ootod act i v i ty , comprising: 

a first set of control objects configured for selecting a system component within 
the controlled environment, wherein, 

activation of a control object from said first set denotes said selected 
system component and populates the user interface with control options, 

each control option is associated with a sequence of commands that, if 
executed, sends instructions to control the operations or functions of said selected 
system component i n aooordanoo w i th tho so l ootod act i v i ty ; 
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a second set of control objects displayed concurrently with said control options 
associated with said selected system component, wherein, 

each control object within said second set of control objects is 
oonf i aurab l o for v i ow i ng configured to allow viewing of the respective control obiect on 
the user interface and represents an affiliate system component assoc i atod w i th tho 
so l ootod act i vity and is oapab l o of configured to allow providing oLan input to said 
selected system component, 

activation of a control object from said second set populates the user 
interface with control options for an affiliate system component associated with the 
activated control object from the second set, 

each control option for said affiliate system component is associated with 
a sequence of commands that, when executed, sends instructions to control the 
operations or functions of said affiliate system component i n aooordanoo w i th tho 
so l ootod activity , and 

said control options for said affiliate system component are displayed 
concurrently with said second set of control objects on the user interface; af^ 

a third set of control objects representing one or more affiliate system 
components, the one or more affiliate system components configured to provide b etm 
oapab l o of providing an input to said selected system component and associatod w i th 
perform i ng tho so l ootod act i v i ty and oapab l o of bo i ng oontro ll od by proxy v i a a contro l 
object from sa i d f i rst sot and/or sa i d socond sot of contro l objoots , and wherein the third 
set of control objects are configured to be pre-configured by a user to be hidden from 
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display on the user interfac e, wh il e ma i nta i n i ng the user i ntorfaco at a constant s i ze 
rogard l oss of whether the th i rd sot of contro l objoots are d i splayed or h i dden from 
d i sp l ay ; and 

device definition device confioured to specify associations amono one or more 
affiliate system components and a primary system component, and thereby establishing 
a chain of system components including said primary system component and said one 
or more affiliate system components, wherein said primary system component is 
associated with a primary control object from said first set, wherein activation of said 
primary control object populates the user interface with control options for executing 
commands to send instructions to control operations or functions of said chain of 
system components . 

Please amend Claim 13 as follows: 

A method of managing a plurality of system components within a controlled 
environment for perform i ng a so l ootod act i v i ty , compnsing: 

presenting, on a user interface, a first set of control objects, each object being 
associated with one or more system components within the controlled environment; 

selecting a system component in response to receiving an activation signal 
associated with a control object from said first set; 

populating said user interface with control options for the selected system 
component; 
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associating each control option witli a sequence of executable commands that 
sends instructions to control the operations or functions of the selected system 
component i n aooordanoo w i th tho so l ootod act i v i ty ; 

presenting, on said user interface concurrently with said control options 
associated with said selected system component, a second set of control objects, 
wherein each control object within said second set of control objects represents an 
affiliate system component assoo i atod w i th tho so l ootod act i v i ty and oapab l o of 
configured to allow providing oLan input to the selected system component and oapab l o 
of be i ng contro ll od by proxy via a contro l objoot from sa i d f i rst sot of contro l objoots, and 
has boon configured for viewing on said user interface; 

presenting, on said user interface concurrently with said second set of control 
objects, control options for an affiliate system component in response to activating a 
control object from said second set; 

hiding from display on the user interface one or more affiliate system 

configured by a user not to be displayed , wh il o ma i nta i n i ng tho usor i ntorfaoo at a 
constant s i zo rogard l oss of whothor tho ono or moro aff ili ato systom oompononts aro 
d i sp l ayed or h i dden from d i sp l ay ;-afld 

associating eaet^ control options for each affiliate system component configured 
for viewing on the user interface with a sequence of executable commands that sends 
instructions to control the operations or functions of said affiliate system component 
configured for viewing on the user interface and said one or more affiliate system 
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components configured by a user not to be displayed on the user interface m 
aooordanoo w i th tho oo l ootod act i v i ty and ; 

associating eael^ the control options for eael^ the selected system component 
with a sequence of executable commands that sends instructions to control the 
operations or functions of the selected system component and/or the one or more 
affiliate system components configured by a user not to be displayed on the user 
interface i n aooordanoo w i th tho oo l ootod act i v i ty : and 

specifying associations among one or more affiliate system components and a 
primary system component, and thereby establishing a chain of system components 
Including said primary system component and said one or more affiliate system 
components, wherein said primary system component is associated with a primary 
control obiect from said first set, wherein activation of said primary control obiect 
populates said user Interface with control options for executing commands to send 
Instructions to control operations or functions of said chain of system components . 

Please amend Claim 27 as follows: 

A computer program product comprising a computer useable medium having 
computer readable program code means embedded In said medium for causing a 
computer to manage a plurality of system components within a controlled environment 
to perform a so l octod act i v i ty , comprising: 
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first computer readable program code means for presenting, on a user interface, 
a first set of control objects, each object being associated with one or more system 
components within the controlled environment; 

second computer readable program code means for selecting a system 
component in response to receiving an activation signal associated with a control object 
from said first set; 

third computer readable program code means for populating said user interface 
with control options for the selected system component; 

fourth computer readable program code means for associating each control 
option with a sequence of executable commands that sends instructions to control ^ 
operations or functions of the selected system component i n aooordanoo w i th tho 
so l ootod act i v i ty ; 

fifth computer readable program code means for presenting, on said user 
interface concurrently with said control options associated with the selected system 
component, a second set of control objects, wherein each control object within said 
second set of control objects is configurable for viewing on said user interface and 
represents an affiliate system component associatod w i th tho oo l octod act i v i ty and 
capab l e of configured to allow providing of an input to the selected system component 
and capab l e of be i ng contro ll ed by proxy v i a a contro l object from sa i d first sot of contro l 

sixth computer readable program code means for presenting, on said user 
interface concurrently with said second set of control objects, control options for an 
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affiliate system component in response to activating a control object from said second 
set; 

seventh computer readable program code means for associating each control 
option for said affiliate system component with a sequence of executable commands 
that sends instructions to control the operations or functions of said affiliate system 
component i n aooordanoo w i th tho so l octod act i v i ty ;-aRd 

eighth computer readable program code for hiding from display on the user 
interface one or more affiliate system components that aro assoo i atod w i th perform i ng 
tho so l octod act i vity , but are pre-configured by a user not to be displayed , wh il e 
ma i ntain i ng tho usor i ntorfaoo at a constant o i zo rogard l oss of whothor tho ono or moro 
aff ili ato svstom oompononts aro d i sp l avod or h i dden from d i sp l ay ; and 

ninth computer readable program code means for associating one or more 
affiliate system components and a primary system component, and thereby establishing 
a chain of system components including said primary system component and said one 
or more affiliate system components, wherein said primary system component is 
associated with a primary control obiect from said first set, wherein activation of said 
primary control object populates said user interface with control options for executing 
commands to send instructions to control operations or functions of said chain of 
system components- 
Claim 41 : 

On [line 2/ of the claim, please change "the one" to --one--. 
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Claim 42: 

On [line 2/ of tine claim, please change "the one" to --one--. 
Claim 43: 

On [line 37 of the claim, please change "the one" to -one-. 

Allowable Subject Matter 

3. Claims 1 , 5, 1 3, 1 9, 21 , 22, 24, 27, and 33-43 are allowed. 

4. The following is an examiner's statement of reasons for allowance: 
Examiner has carefully considered claims 1, 5, 13, 19, 21, 22, 24, 27, and 33-43. 

None of the cited arts of records discloses, suggests, nor teaches managing a plurality 
of system components within a controlled environment comprising a first set of control 
objects configured for selecting system component within the controlled environment... 
a second set of control obiects disolaved concurrentiv with said control options 
associated with said selected system component, wherein, each control object within 
said second set of control objects... represents an affiliate system component and is 
configured to allow providino of an input to said selected system component , activation 
of a control object from said second set populates the user interface with control options 
for an affiliate system component associated with the activated control object from the 
second set... said control options for said affiliate system component are disolaved 
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concurrently with said second set of control objects on the user interface, a third set of 
control objects representing one or more affiliate system components, the one or more 
affiliate system components configured to provide an input to said selected system 
component , and wherein the third set of control objects are configured to be pre- 
confiqured by a user to be hidden from display on the user interface; and device 
definition device configured to specify associations among one or more affiliate system 
components and a primary system component, and thereby establishing a chain of 
system components including said primary system component and said one or more 
affiliate system components specified by said input or output links or dependencies, 
wherein said primary system component is associated with a primary control object from 
said first set, wherein activation of said primary control obiect populates the user 
interface with control options for executing commands to send instructions to control 
operations or functions of said chain of system components , as recited in claim 1 . 

The closest prior art, Hasha et al (U.S. Patent No. 6,734,879), discloses a 
method and system for generating a user interface for controlling software components 
through a user control point device [column 2, lines 25-27]. A main portion of a display 
contains menu items implemented as buttons for various components associated with 
the current space. The components relate to audio/video, lighting, climate control, 
elevator control, art control, and high resolution monitor control [column 4, lines 49-55; 
figure 1]. When a user selects one of the buttons, the user interface for the 
corresponding software component is provided by a user interface component for that 
software component [column 4, lines 55-58]. [Figure 2] illustrates a display after the 
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audio/video button has been selected. The main portion reflects options relating to 
controlling audio/video [column 5, lines 5-8]. As shown, the main portion contains a 
control center component corresponding to an entertainment center, an ambient audio 
hardware component, or other hardware component for controlling various control 
center components within the space [column 5, lines 13-18]. Various program selector 
buttons are provided for controlling various programs such as a movie, television 
channel, or music albums [column 5, lines 10-13]. [Figure 3], which shows a display 
after the music album selector button has been selected. Various controls in the main 
portion allow the user to select an available album and to direct the music to a hardware 
component, such as the ambient audio component [column 5, lines 20-27]. Each user 
control point (UCP) device includes a list of spatial services that can be controlled by 
the user. The UCP object may identify its corresponding space from configuration 
information and establish a tracking reference to the space object for the corresponding 
space. The identity of the corresponding space can be obtained from any number of 
places including a registry system whose information can be manually entered or 
automatically established from user preferences [column 6, line 19 to column 7, line 4]. 
Hasha does not teach all the limitations above. 

A second close prior art, Sharood et al (Pub. No. US 2002/0022991 A1), 
discloses a similar system for providing a user interface for controlling distributed 
devices [paragraph 13]. [Figure 7c/ shows an interface for managing a plurality of 
system components. As shown, a user selects a first set of control objects such as 
temperature, appliances, scenes, lighting, audio/video, and intercom. A second set of 
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control objects is displayed within tool bar 752 along with concurrently displayed control 
options 754 and 755 corresponding to a selected one of the control objects from the tool 
bar. Displaying the second set of control objects concurrently with the control options 
allows users to more easily switch between selections. Sharood does not teach all the 
limitations above. 

A third close prior art, Dresti et al (Pub. No. US 2003/0103088 A1), discloses an 
electronic device having a remote control application user interface that functions to 
display operational mode information to a user [paragraph 4, lines 1-4]. A wheel 110 
[figure //y contains icons representing devices and/or activities [paragraph 142, lines 1- 
3]. The icons function as soft keys that may be selected to cause the performance of a 
further action, for example, to display a device control page, cause the transmission of 
commands, etc. [paragraph 138, lines 5-9]. Users can select the devices by clicking on 
the appropriate icon in the wheel, wherein a page of control functions for that device 
would be displayed [paragraph 151, lines 10-15; figure 19a]. The home screen device 
wheel 110 may contain device and activity icons [paragraph 142, lines 1-3]. When 
editing an activity icon, the user is presented with a set of control objects in which to 
select the device to be operated. Selecting a device would then populate the interface 
with a set of control options for that device. A series of keystrokes is then input, which 
would control the selected device when the activity icon is run [paragraph 212, lines 9- 
14; paragraph 180, lines 6-24]. Further, activities represent a desired configuration of 
one or more devices that is centered around a given pastime. For example, a 'watch 
movies' activity might be setup to cause the transmission of commands to select the 
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DVD player as the audio/video source, set the surround sound mode on the audio 
amplifier, switch the TV input to S-Video, etc. [paragraph 137, lines 14-20]. Thus, in 
order to setup an activity involving multiple system components, an affiliate system 
component may be selected and configured by presenting an interface with a set of 
control option for the affiliate system component. If an activity has already been 
established and a user wishes to edit the activity, the user would be able to identify any 
devices being operated by the activity, including a first component and any affiliate 
components. Dresti does not teach all the limitations above. 

Similar subject matter is disclosed in independent claims 13 and 27. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 



Conclusion 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ALVIN TAN whose telephone number is (571)272-8595 . 
The examiner can normally be reached on Mon-Fri 9:00-5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Boris Pesin can be reached on 571 -272-4070. The fax phone number for 
the organization where this application or proceeding is assigned is 571 -273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Alvin H Tan/ 

Primary Examiner, Art Unit 2172 



